Software release workflow management

ABSTRACT

A computer-implemented method for managing a release of a software product includes obtaining a request for the release, the request including workflow action parameter data to define a release pipeline involving a plurality of software engineering systems configured to process data indicative of the software product, and executing, with a processor, a workflow to implement the release pipeline in accordance with the workflow action parameter data. Executing the workflow includes sending a series of instructions to the plurality of software engineering systems. A successive instruction in the series of instructions is sent based on whether a gating rule for the release is met.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation application of co-pending U.S. patentapplication Ser. No. 13/828,842, entitled “Software Release WorkflowManagement” and filed on Mar. 14, 2013, the entire disclosure of whichis hereby incorporated by reference.

BACKGROUND OF THE DISCLOSURE Brief Description of Related Technology

Software development typically involves a build process that compilessource code files into binary packages for release to a production ordelivery environment. Some software development projects may involvethousands, or even hundreds of thousands, of source code files having acomplex dependency structure. A change in one source code file may thuscause undesirable conditions or unexpected results and failures for alarge number of other source code files.

A software release typically includes one or more validation or testingprocedures during which the results of a software build are tested.Software releases of complex products also usually involve multipleenvironments in which such testing occurs. For example, after adevelopment team indicates that the source code development has reacheda certain milestone, the software product is often sent to anintegration environment in which a given component is tested againstdependent systems or multiple development branches are tested. In somecases, after the integration environment, the software product may bereleased to a staging environment for further validation beforeeventually moving to a production environment.

SUMMARY OF THE DISCLOSURE

Methods, systems, and computer program products are directed to managinga software release workflow. One or more gating rules may be used toautomate the management of the software release workflow.

In accordance with one aspect of the disclosure, successive instructionsto a plurality of software engineering systems are implemented in arelease pipeline for a software product based on whether a gating rulefor the software product is met.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

DESCRIPTION OF THE DRAWING FIGURES

For a more complete understanding of the disclosure, reference is madeto the following detailed description and accompanying drawing figures,in which like reference numerals may be used to identify like elementsin the figures.

FIG. 1 is a block diagram of an exemplary system configured for softwarerelease workflow management in accordance with one embodiment.

FIG. 2 is a block diagram of a release pipeline orchestrator of thesystem of FIG. 1 in accordance with one embodiment.

FIG. 3 is a flow diagram of an exemplary computer-implemented method forsoftware release workflow management in accordance with one embodiment.

FIG. 4 is a block diagram of a computing environment in accordance withone embodiment for implementation of the disclosed methods and systemsor one or more components or aspects thereof.

While the disclosed systems and methods are susceptible of embodimentsin various forms, specific embodiments are illustrated in the drawing(and are hereafter described), with the understanding that thedisclosure is intended to be illustrative, and is not intended to limitthe invention to the specific embodiments described and illustratedherein.

DETAILED DESCRIPTION

Methods, systems, and computer program products are described formanaging a release of a software product. The management of the releaseis supported via workflows directing the operations of multiple softwareengineering systems involved in the release. The workflows of thedisclosed embodiments establish a release pipeline that integrates theservices of the software engineering systems. Implementation of therelease pipeline is automated by the disclosed embodiments despite theoften complex nature of the services provided by the softwareengineering systems, which may involve internal workflows of their own.

Interaction with the software engineering systems and execution of theworkflow is automated via the application of a number of policy orgating rules. The gating rules may provide decision logic and othercustomizations to support an efficient implementation of the workflow.For example, execution of the workflow may include automated checks forvarious compliance parameters, such as whether the correct individualshave approved the release or a specific step of the workflow. Otherautomated checks may involve policies or rules related to qualityassurance. The workflow may thus include, direct, and otherwise controldifferent aspects or phases of the release lifecycle, such as a buildprocess and a validation process. The disclosed embodiments may alsoautomate the definition of a release pipeline via a front end or userinterface and/or other interfaces (e.g., an application programminginterface (API)) through which a release request is received or obtainedto initiate a release.

The disclosed embodiments may be employed to improve the efficiency ofthe entire release process or cycle. The disclosed embodiments automatethe release process beyond automation of the procedures implementedwithin a specific one of the software engineering systems (e.g., buildautomation). The automation of the entire release cycle provided by thedisclosed embodiments may enable software developers to release softwareproducts more quickly and more often without sacrificing otherinterests, such as maintaining compliance and security. For example,with the disclosed embodiments, release transactions and other actionsneed not be tracked or implemented via emails, spreadsheets, or otherinefficient, manual processes. By removing such manual steps in therelease process, an agile, seamless, or continuous release experiencemay be provided via the disclosed embodiments. The efficiencyimprovements may also be facilitated through scaling (e.g., cloud-basedscaling) and/or higher availability (e.g., protection against local orregional outages) of the release management services provided by thedisclosed embodiments.

Notwithstanding references herein to various commercially availablesoftware engineering services managed via the disclosed embodiments, thedisclosed embodiments are not limited to any particular type ofengineering service or provider thereof. Although described inconnection with cloud-based services, the disclosed embodiments are notlimited to any specific operating system, environment, platform, orcomputing infrastructure. The disclosed embodiments may be used tomanage the release of various types of software products.

The nature of the releases managed via the disclosed embodiments mayvary. For example, a release need not involve a full or complete releaseof a software product to production. Instead, the release may involve apartial release, such as a patch, hotfix or quick fix update to thesoftware product, or a configuration change. The final stage ordestination of the release need not involve production or deployment.For example, the release may be an internal release between releaseenvironments within the manufacturer, such as an integration environmentand a staging environment.

FIG. 1 depicts a software development environment 100 for development ofone or more software products. The software development environment 100includes a release management system 102 or service configured to managea software release workflow. The software development environment 100includes a plurality of software engineering systems used during thesoftware development process. Various combinations of the softwareengineering systems may be applied to the software product in a releasepipeline established by the release workflow. The software engineeringsystems may be discrete systems or integrated to any desired extent. Forexample, one or more of the software engineering systems may be providedas a separate software service. In this example, the softwareengineering systems include a source control system 104, a build system106, a validation system 108, a project management system 110, adeployment infrastructure 112, and an alert system 114. Additional,fewer, or alternative systems may be provided. For example, the softwareengineering systems may include a content distribution serviceconfigured to distribute build outputs (e.g., binary files,configuration data, and other artifacts) to various distributions (e.g.,worldwide) and to provide services, such as a build directory service,which may discover builds and use validations to ensure the integrity ofcontent is retained upon delivery. Such content distribution servicesmay be integrated with the build system 106, the deploymentinfrastructure 112, or be configured as standalone services.

Each of the software engineering systems is configured to process dataindicative of the software product(s) under development. One or more ofthe software engineering systems may be provided as a service (e.g., ina client-server framework) or otherwise involve a distributed computinginfrastructure. One or more of the software engineering systems may thusbe provided or supported via a cloud or other networked computingarrangement. For example, the build system 106 may be configured inaccordance with the teachings of U.S. Patent Publication No.2013/0055253 (“Cloud-based Build Service”), the entire disclosure ofwhich is hereby incorporated by reference. The software engineeringsystems need not be provided separately as shown in FIG. 1. The softwareengineering systems may be integrated to any desired extent. Forinstance, some or all of the software engineering systems may be coupledin one or more ways. In some examples, the coupling may involve a sharedrepository or other resource and/or involve interaction orcommunications, such as via an API. For example, one or more sourcecontrol services, one or more project management services, and/or otherservices may be provided via a common server, such as a serverconfigured in accordance with the Team Foundation Server platform fromMicrosoft Corporation, which may be provided as part of a Visual Studio®system, such as the Visual Studio® Application Lifecycle Managementsystem.

The source control system 104 may be directed to version or revisioncontrol and other management of the source code for the softwareproduct. In one example, the source control system 104 utilizes thePerforce revision control system (Perforce Software, Inc.), but anysource control system may be used. The source control system 104 mayinclude one or more repositories for the source code data or files. Therepositories may be local or distributed. For example, the repositoriesmay be located and arranged in a cloud infrastructure. The source codemay be written in any one or more languages, and the platform oroperating system for the source code may also vary.

The build system 106 may be directed to automating the process ofcompiling the source code data into binary code, and packaging thebinary code. The build system 106 may include a number of tools andrepositories for processing and handling the source code and binary codefiles and data. For example, the build system 106 may include,configure, or access a file server in which the results of a build arestored. Any build software, tool, and/or infrastructure may be used inthe build system 106. In one example, the build system 106 utilizes theMSBuild build platform (Microsoft Corporation), which may be availablevia or in conjunction with the Microsoft® Visual Studio® integrateddevelopment environment. Other build systems and/or integrateddevelopment environments may be used.

The validation system 108 may be directed to validating the operabilityof the binary code, which may include a set of binaries. The validationsystem 108 may be configured to execute a number of tests configured todetermine whether the binary code works as intended. For example, one ormore tests may be configured to determine whether the binary code meetsa number of specifications for the software product. A variety ofdifferent types of testing may be provided, including, for instance,unit testing, functional testing, stress testing, fault injection,penetration testing, etc. Other types of validation processes may beimplemented by the validation system 108, including, for example,compliance validation and security validation.

The project management system 110 may be directed to gathering,tracking, and/or storing data indicative of a record of the releaseprocess. For example, work item tracking, incident tracking, deploymenttracking, and other item tracking may be implemented by the projectmanagement system 110 to support the execution of the release pipeline.The project management system 110 may be used to provide a signal orother data to the release management system 102 to indicate that aparticular action is complete, complete with faults, etc. The projectmanagement system 110 may alternatively or additionally be configured toprovide logging functionality for the release management system 102.Such logging may be useful in a variety of ways. For example, the logdata may include, for example, compliance data, such as the identity ofa user who approved a step in the release process. The projectmanagement system 110 may include a repository, such as a persistentstore, in which such log and other release process data is stored. Theproject management system 110 may include a manager (e.g., a databasemanager) and user interface for accessing, handling, or otherwiseprocessing the release process data (e.g., generating businessintelligence reports). The project management system 110 may include aMicrosoft® SQL Server® or SQL Azure™ database management system fromMicrosoft Corporation, but other database management systems orarchitectures may be used. In some examples, the project managementsystem 110 may include the above-referenced Team Foundation Serverplatform from Microsoft Corporation, but other services may be used.

The deployment infrastructure 112 may be directed to an automateddeployment of the software product. The deployment infrastructure 112may include a gateway or other service configured to support softwareproduct updates. For example, if the software product is configured forcloud-based execution, the deployment infrastructure 112 may include aservice for distributing the software product to one or more datacenters, virtual machines, etc. The software development environment 100need not include the deployment infrastructure 112 in some cases, suchas when the software product is not electronically distributed.

The alert system 114 may include an alert or monitoring service tosupport communications with users beyond any dedicated or other userinterfaces of the release management system 102. The communications mayinclude alerts and other messages to inform users of an event, such as afailure (e.g., a build failure), that occurs during implementation of aworkflow. The messages may utilize a variety of communication protocolsand media, including, for instance, emails and text messages, but othermessaging frameworks may be used. The alert system 114 may be acloud-based monitoring service, such as the Windows Azure™ Alert andIncident Monitoring Service (AIMS) from Microsoft Corporation, butnon-cloud monitoring services may be used.

In some embodiments, one or more functions of the alert system 114 maybe integrated with the release management system 102. For example,monitoring and/or evaluation of the release process (e.g., to detectevents warranting an alert) may be implemented by a module of therelease management system 102. The embodiment of FIG. 2 provides someexamples of such monitoring. The alert system 114 may then be instructedto transmit an email or other message regarding the event detected.

In the embodiment of FIG. 1, the release management system 102 includesan orchestrator 116 (or orchestrator server), a policy engine 118, and afront end system 120 (or front end server). The orchestrator 116 may beconfigured to direct or otherwise communicate or interact with acombination of the above-referenced software engineering systems toestablish a release pipeline. The orchestrator 116 may support orfacilitate communications between the software engineering services. Thepolicy engine 118 may be configured to apply or enforce gating rules orother policies or decision logic during the release process. The frontend system 120 may be configured to support user configuration of therelease management system 102, monitoring of the release process, andother user interaction with the release management system 102. Thecomponents of the release management system 102 may be implemented onseparate computers (e.g., server computers) or computing systems (e.g.,sets of server computers), or on a common computer or computing system.Each such computer or computing system may be configured as a virtualmachine.

One or more of the components of the release management system 102,e.g., the orchestrator 116, may be configured to manage multiple releasepipelines for one or more software products. As described herein, therelease management system 102 may be configured to provide the releasemanagement services in a parallel processing architecture orarrangement. For example, the release management system 102 may includemultiple instances of the orchestrator 116 to orchestrate multiplerelease pipelines for one or more software products. Similarly, therelease management system 102 may include multiple instances of thepolicy engine 118 and/or the front end system 120. The multipleinstances may be arranged in a cloud-based service framework that allowsthe number of instances to be scaled in accordance with demand. Thecomponents of the release management system 102 may be integrated to anydesired extent. For example, the policy engine 118 may be an integralpart of the orchestrator 116. In some cases, various combinations of theservices provided by the orchestrator 116, the policy engine 118, and/orthe front end system 120 are implemented on a common computer (e.g.,server computer) or computing system.

The orchestrator 116 may include a workflow engine 122 to implementworkflows involving the above-described software engineering services.The workflow engine 122 may correspond with the workflow managerprovided as a part of the Microsoft® Windows® Workflow Foundationframework from Microsoft Corporation, although other workflow managersor engines may be used. As described below, the workflow engine 122and/or the orchestrator 116 are configured to manage communications withthe software engineering services, process workflow parameter data toprovide a workflow to implement a release pipeline configured inaccordance with such workflow parameter data, and execute the workflowto send instructions to the software engineering systems. For example,the parameter data may specify that the release pipeline be configuredto include an integration step, a build step, a deployment step, and acode movement step. In another example, the parameter data may specifythat the release pipeline be configured to include a code movement step,a build step, a validation step (e.g., for unit testing), a deploymentto integration step, a further validation step (e.g., for functional,stress, and penetration testing for validation of a service), a furthercode movement step, and a deploy to production step. The steps and steporder in the release pipeline may vary considerably. For example, otherrelease pipelines may not have code movement steps due to the absence ofa branching architecture. Some steps need not involve processing of codefor the software product. For example, other pipelines may includeinstructions for gathering and displaying metrics regarding the release,as described below.

Data indicative of and/or resulting from the workflows, such astemporary or log data, may be stored in a workflow data store 124. Thetemporary data may be indicative of the workflow execution, which may beuseful to support recovery in the event of a failure. The workflow datastore 124 may include one or more local data stores or a distributeddata store in communication with one or more processors used toimplement the workflow engine 122.

Implementation of the release workflow may be initiated via a requestreceived or otherwise obtained via the front end system 120. The requestmay specify or otherwise include workflow action parameters or parameterdata to define a release pipeline involving a combination of theabove-described software engineering systems. For example, the requestmay specify a software product, one or more source control branches,file directories or other locations, one or more change lists, one ormore release environments (e.g., a target environment), and acombination of actions (e.g., build, validate, deploy, validate, etc.)to be implemented in the release. In the embodiment of FIG. 1, the frontend system 120 may be configured to generate a user interface 126 tosupport the entry of the request and the workflow action parameter data.A workflow action parameter data package 128 may be passed from thefront end system 120 to the orchestrator 116 and/or the workflow engine122. The workflow action parameter data package 128 may includeparameters or data indicative of or specifying one or more aspects ofthe release pipeline or the workflow. The parameters or data may includedata in addition to that provided via the request or the user interface126. The workflow action parameter data package 128 may be configured asa release specification. In some cases, the workflow action parameterdata package 128 is received by the orchestrator 116 via an API endpoint of the orchestrator 116. Other communication schemes may be used.For example, the workflow action parameter data package 128 may bederived from a user interface input process that provides a user anopportunity to reuse or otherwise select a previously used workflow,workflow action, or other workflow parameter or data.

The release pipeline and the workflow may be defined by the orchestrator116 and/or the workflow engine 122 in accordance with the workflowparameter data in the workflow action parameter data package 128. Forexample, the orchestrator 116 and/or the workflow engine 122 mayincorporate the workflow parameter data into a workflow template. Theorchestrator 116 and/or the workflow engine 122 may be configured toselect a template from a plurality of templates stored in, e.g., theworkflow data store 124. The selection of the template may be based onone or more aspects of the workflow parameter data, such as thecombination of actions requested. In one embodiment, a template isprovided for each respective release environment (e.g., a testenvironment, a production environment, etc.). The front end system 120may be configured to facilitate modifications to the workflow templates.In some embodiments, an API may be provided to facilitate an upload ofone or more workflows for selection. Alternatively or additionally, theworkflows may be modified during execution thereof.

During the implementation of the release workflow, a record of theworkflow actions or steps executed may be stored by the releasemanagement system 102 in a persistent store 130 in communication withthe orchestrator 116 and/or the release management system 102. Thepersistent store 130 may be provided by a cloud-based storage service.The persistent store 130 may be configured for durable storage of avariety of different types of data. For example, data indicative of eachworkflow action implemented during the workflow, as well as the resultsof each action, may be recorded or stored in the persistent store 130.For instance, the binary files resulting from a build may be stored inthe persistent store 130. The workflow may be configured with one ormore checkpoints at which data indicative of the state of the release isstored in the persistent store 130. If a failure occurs after thecheckpoint, the data stored at that time may be relied upon to restartthe workflow from the checkpoint. The data stored at a checkpoint mayalso be used to support the execution of multiple instances of therelease pipeline. The data may also be used for scalability. Forexample, a workflow started on a first server may be resumed by anotherserver, if, for instance, the first server becomes overloaded or istaken out of service (e.g., through maintenance or by failure).

Other types of result data may be stored by the release managementsystem 102 in the persistent store 130. For example, result dataidentifying storage locations for the build results may be recorded inthe persistent store 130. In another example, the result data may beindicative of the status or other operational characteristic of theworkflow or release. The operational characteristic(s) to be recorded orgathered may be identified in the request received via the front endsystem 120. The persistent store 130 may provide storage redundancy forone or more types of data stored in the workflow data store 124.

Metric data 132 indicative of the release workflow(s) may be returnedfrom the release management system 102 or the workflow engine 122 to thefront end system 120. The front end system 120 may, in turn, pass themetric data 132 to the persistent store 130. The metric data 132 mayalternatively or additionally be stored directly in the persistent store130 or through a different intermediary device or system, such as theabove-referenced monitoring system or other monitoring system orservice. The metric data 132 may be alternatively or additionallyprovided to the user via a dashboard 134 generated by the front endsystem 120. The metric data 132 may be indicative of the progress,status, or other operational characteristic of the release workflowsbeing managed by the release management service 102. For example, themetric data 132 may be representative of how long a particular step of arelease took to execute, of how many releases are currently beingexecuted, or of the results of one or more tests at varying levels ofspecificity (e.g., either individual or aggregated test results). One ormore characteristics of the metric data 132 may be specified via theuser interface 126. For instance, the user requesting a release mayspecify the types of metric data 132 to be displayed via the dashboard134. The front end system 120 may be configured for telemetriccommunications with the orchestrator 116 to support the gathering of themetric data 132.

A request for the metric data 132 may be provided or received at varioustimes. The metric data 132 may be requested along with the request toinitiate a release workflow. Thus, in some embodiments, the workflowaction parameter data package 128 includes data indicative of the typesof metric data 132 requested. Alternatively or additionally, a requestfor the metric data 132 may be received via the user interface 126 afterthe initiation of the workflow. The front end system 120 may then beconfigured to send a message to the orchestrator 116 requesting themetric data 132. The message may include instructions to gather themetric data 132. The request may be received by the orchestrator by theabove-referenced API end point. The metric data 132 may alternatively oradditionally be used to trigger automatic alerts about, e.g., systemstates. For example, an alert may be triggered in the event that themetric data 132 indicates that the duration of a certain process in thesystem exceeds a predetermined threshold. The data may also beaggregated and reported at a later time across multiple releases.

The persistent store 130 may be used by the release management system102 as a long term data storage for some or all of the data stored inthe workflow data store 124. The workflow data may include log data. Thelog data may include data recorded for compliance purposes, including,for instance, the identity of each person providing approval during theworkflow. The release management system 102 may be configured inaccordance with auditing data of, e.g., a retention or other compliancepolicy, to maintain the data in the persistent store 130 for a timeperiod specified via the auditing data. Any number of stores may be usedto provide capacity for the storage of data from a number of releases.For example, the persistent store 130 may include a varying number ofdata stores in a cloud-based framework or other distributed computingarchitecture. The data may also be recorded by or as part of the projectmanagement system 110, which may be useful in, for instance, correlatinga release with work items, incidents, or other workflow events.

The front end system 120 may provide functionality beyond requestingreleases and dashboard displays. In the embodiment of FIG. 1, the frontend system 120 includes an authentication module 136 and anauthorization module 138. The authentication module 136 is configured toauthenticate users of the release management system 102. Theauthentication module 136 may be configured to access one or more userdirectories (e.g., a corporate user directory) or other databases toconfirm user credentials. The authorization module 138 may be configuredto establish or determine user permissions or roles, and the permissionsof such roles, which may then be associated with specific users. In someembodiments, each authenticated user may be assigned to a user rolehaving a set of permissions to, e.g., approve certain workflow actions,as described further below. User or user role permissions may bespecified via an administrator control interface 140 generated by thefront end system 120. Alternatively or additionally, user permissionsmay be specified indirectly, e.g., via a remote service. For example,the user permissions may be specified in accordance with a title (e.g.,project manager) indicated via data made available by the database(s)relied upon for authentication. The user may also have a different role(e.g., approver, initiator, developer, etc.) based on the origin, scope,or other aspect of the release, as described herein. The authenticationmodule 136 and the authorization module 138 may be configured to accessa federated database system or architecture.

Data indicative of a user who approved a particular workflow action maybe stored in the persistent store 130 and/or the workflow data store124. A complete record of the approvals provided during each releaseworkflow may thus be stored, which may be useful for compliance withcorporate, governmental, or other regulations.

The administrator control interface 140 may be configured to allow anadministrator or other authorized user to control other aspects of therelease management system 102. In some embodiments, the administratorcontrol interface 140 may provide various workflow control options. Forexample, a user may direct the workflow engine 122 to suspend, resume,or cancel one or more releases via the administrator control interface140. Suspension of one or more releases may be useful in the event of,for instance, a failure (e.g., test failure) in one development branchthat may have adverse impacts in other branches. The administratorcontrol interface 140 may alternatively or additionally be used tooverride a variety of different actions automated via the releasemanagement system 102. For example, a workflow action specified via atemplate workflow may be skipped or otherwise cancelled. An override tolock any further workflow progress may be useful in certain situations,such as an outage that, until addressed, may adversely impact subsequentreleases for the software product involving other clusters.

The policy engine 118 may provide control logic for the releasemanagement system 102. The control logic may be called or otherwiserelied upon to determine whether to proceed with a workflow action inthe release workflow. The control logic may include or be configured asa set of policy or gating rules. In this embodiment, the gating rulesare set forth in a policy schema 142. The policy schema 142 may beconfigured as a data file or document, such as an extensible markuplanguage (XML) document. The format, language, and other characteristicsof the policy schema 142 may vary. The policy engine 118 may access avariety of different policy or configuration specifications to obtainthe gating rules. With a particular gating rule of the policy schema 142available, the policy engine 118 is configured to direct theorchestrator 116 and/or the workflow engine 122 to send a successiveinstruction based on whether the gating rule is met. Alternatively oradditionally, such direction of the orchestrator 116 and/or the workflowengine 122 may follow a request sent to the policy engine 118 from theorchestrator 116 and/or the workflow engine 122 on whether to proceedwith a successive step in the workflow.

The policy schema 142 and/or the gating rules may be used to customizeor configure the release workflow. Such customization may be at a highlevel. For example, the release workflow may be configured as a testworkflow (e.g., a test to release workflow), a release-to-productionworkflow, or other release workflow. Such high level customization maybe determinative of which software engineering systems are involved orincluded in the release pipeline and, in some cases, the order in whichsuch systems are called upon.

The policy schema 142 and/or gating rules may customize the releaseworkflow at an intermediate level in which the operation of the softwareengineering systems is configured. For example, the policy schema 142may specify a test schema or set of tests to be implemented by thevalidation system 108. A workflow may be designed to implement onlycertain tests (or types of tests) made available by the validationsystem 108. Alternatively or additionally, the policy schema 142 and/orthe gating rules may be configured to initiate an automated testselection routine, in which the tests (or types of tests) are selectedbased on environmental variables or other parameters of the release. Forexample, the test selection routine provided in the Team FoundationServer platform from Microsoft Corporation may be used.

Even more detailed levels of logic may be specified via the gatingrules. For example, the policy schema 142 may include a gating rulespecifying a code coverage threshold (e.g., 50% pass or 70% pass) to bemet during validation. If the code coverage is below the threshold, thenthe workflow does not proceed to the next workflow action (e.g., asubsequent test, a deployment, etc.). The orchestrator 116 may insteadsend an instruction to the alert system 114 regarding the code coveragefailure. In another example, the policy engine 118 may be configured viathe policy schema 142 to apply gating rules regarding a state of aproduction environment. The policy engine 118 may instruct theorchestrator 116 to validate that the state of the productionenvironment before releasing a build of the software product to theproduction environment. The policy schema 142 may specify one or morevalidation criteria as gating rules for the validation process. In yetanother example, a gating rule may be used to specify a location (e.g.,a specific cluster) to which the software product is to be deployedand/or the circumstances under which such deployment occurs. A varietyof other parameters for the release workflow and pipeline may bespecified via the gating rules, including, for instance, whether thebuild results are to be replicated based on which code branch is built,and when or where to implement forward or reverse integration acrossbranches.

The policy engine 118 may be directed to verification and qualityassurance enforcement. In some embodiments, the gating rules are used bythe policy engine 118 and/or the orchestrator 116 to determine whether aworkflow incident occurs. Failure to meet a gating rule may cause analert (e.g., a text message, email, or other message) to be sent to auser(s) authorized to respond to the workflow incident. The user(s) towhich the alert is sent may be determined via the policy schema, theworkflow, the workflow action parameter data package 128, and/or dataspecified via the authorization module 138. For example, theauthorization module 138 may be used to establish that only users havingproject manager or higher roles are authorized to respond to workflowincidents of a certain level. The policy schema 142 may be relied uponto classify the various workflow incidents by level. The workflow engine122 may be configured to resume the workflow based on a response to thealert from an authorized user.

The policy schema 142 (or other logic source) may include or specify avariety of transition criteria for the release workflow. Some transitioncriteria may be configured or applied as entry criteria. A gating rulemay specify that a certain condition is met before allowing a workflowaction to begin. For example, a condition may specify that a user havinga Security Expert role provides signoff that a release has been reviewedfor compliance with security practices, that appropriate SecureDevelopment Lifecycle (SDL) tools from Microsoft Corporation (or othersecurity assurances processes) have been run on the code to verifyproper processes, or that code review has been done for the change byappropriate person(s) as specified by a compliance policy. Other gatingrules may be configured or applied as exit criteria. A gating rule mayspecify that a certain condition is met before allowing a workflowaction to be completed. For example, a condition may specify thatcontinuous testing showed proper results (e.g., in accordance withservice level agreement (SLA) restrictions) for all actions, or that nocustomer-impacting incidents were created during the time taken tovalidate the released changes (e.g., bake time), or that all of theservice components entered steady-state and have not resulted in newfailures.

The gating rules and, thus, the workflow policy, may be predetermined orpredefined to support the implementation of the release workflow in avariety of ways. For example, the gating rules need not be specified viaa discrete configuration file as shown in FIG. 1. One or more gatingrules may instead be specified in a workflow template and/or theworkflow action parameter data package 128. For example, the workflowaction parameter data package 128 (or other source of the gating rules)may specify a code coverage threshold (e.g., 80%). In another example,the workflow action parameter data package 128 (or other source of thegating rules) may specify a location of the source code for processing.The decision logic for the gating rules may alternatively oradditionally be specified via workflow instructions incorporated (e.g.,hard-coded) into the workflow template. For instance, the gating rulesmay be partially or fully hard-coded into the workflow template.

The policy engine 118 may include an interpreter or other data processorconfigured to evaluate data indicative of the gate rules. In oneembodiment, the data may be arranged in a set of classes, an objectlibrary, or other data structure. The data structure may be set forth inan XML or other framework in one or more data files. The interpreter orother data processor of the policy engine 118 may then be configured toread the data structure to determine or load the gate rules.Alternatively or additionally, data indicative of the gate rules is setforth in a dynamic link library (DLL) file(s) or other compiled orprocessed format. In some cases, the gate rules may be set forth ascode, instructions, or other logic, rather than data used to configureor customize such logic.

FIG. 2 shows the orchestrator 116 and the workflow engine 122 thereof ingreater detail. The orchestrator 116 may include a number of modulesdirected to interactions with the software engineering systems toachieve desired workflow results. In this example, the orchestrator 116includes a communication manager 150 or other interface to supportcommunications with the software engineering systems. The communicationmanager 150 may include or consult a lookup table or other logic todirect messages or other data exchanges to the appropriate softwareengineering system(s). The format, protocol, and other characteristicsof the communications supported by the communication manager 150 mayvary. For example, the communication manager 150 may send instructionsto the software engineering systems via data exchanges configured inaccordance with the capabilities of the software engineering systems,such as a respective API of the software engineering system. In someembodiments, interaction with an engineering system may be implementedby defining one or more interfaces that describe or reflect thecapabilities of the engineering system. For example, an interface may beconfigured in accordance with the expected capabilities of theabove-referenced source control system. The interface may then becustomized or otherwise implemented to support data exchanges (e.g.,data retrieval) with specific instances of the source control system.

The communication manager 150 may also be configured to supportinteraction with other components of the release management system 102(FIG. 1), such as the policy engine 118 (FIG. 1) and/or the front endsystem 120 (FIG. 1). For example, the communication manager 150 mayprovide an interface for receiving and processing the workflow actionparameter data package 128 (FIG. 1) and/or other workflow actionparameter data. Alternatively or additionally, the communication manager150 may be configured to receive and process data indicative of theresults of the application of the gating rules by the policy engine 118.

The workflow engine 122 may be configured to generate the instructionssent by the communication manager 150 and/or process the messagesreceived by the communication manager 150. In this embodiment, theworkflow engine 122 includes a workflow interpreter 152, a workflowvalidator 154, an execution environment 156, and an event scheduler 158.The workflow interpreter 152 may be configured to interpret workflowcode authored in a workflow language, such as the workflow languageestablished as part of the Microsoft® Windows® Workflow Foundationframework. Any workflow language may be used. The workflow language maydefine a set of primitive instructions configured to implement basicworkflow actions (e.g., skip, cancel, run, run in a loop, run inparallel, change, etc.). The workflow language may be defined or basedupon code written in the C # language and/or in XML script, althoughother high-level languages may be used. The workflow engine 122 may alsoinclude a compiler if the workflow code is presented in an intermediatelanguage for which a compiler is not already available.

The workflow validator 154 may be one of several tools provided by theworkflow engine 122 to author, modify, customize, or otherwise prepare aworkflow or workflow template for implementation in the executionenvironment 156. The workflow validator 154 may be integrated with theworkflow interpreter 152 to any desired extent. Once a workflow (orworkflow template) has been validated, the workflow may be madeavailable for implementation within the execution environment 156. Theexecution environment 156 may be based on or include the Common LanguageRuntime (CLR) environment of the Microsoft® .NET framework and/orMicrosoft® Windows® operating system, but other software runtimeenvironments and frameworks may be used.

In some embodiments, the workflow engine 122 is configured to call thepolicy engine 118 (FIG. 1) to incorporate the gating rules into theworkflow during execution of the workflow (e.g., in the executionenvironment 156). The workflow may thus be configured or customized onthe fly. Alternatively or additionally, data indicative of the gatingrules (and/or other parameter data) is incorporated into the workflowbefore the execution environment 156 is implemented.

The workflow engine 122 and/or other components of the orchestrator 116and the release management system 102 may be implemented in acloud-based framework in which multiple virtual machines areimplementing and managing a number of workflows. The cloud-basedframework may be configured in a manner similar to the cloud-basedservice described in the above-referenced U.S. Patent Publication. Forexample, the cloud-based framework may provide a hosted service, such asa Windows Azure™ hosted service, with a scalable number of virtualmachines providing multiple instances of an orchestrator role, a policyengine role, and/or a front end role of the release management system102. The cloud-based framework may be useful for supporting parallelprocessing of one or more steps or actions of the release workflow. Forexample, virtual machines within one or more data centers may be used toimplement validation testing in parallel. The workflow engine may beexecuted across multiple machines (virtual or physical), which mayfacilitate transfers of workflows across the machines, e.g., through theabove-referenced persistent store and/or other predetermined persistencepoints. Such transfers may provide increased scalability in which manyworkflows are executed in parallel and/or increased resiliency tofailure (e.g., when a machine executing a particular workflow fails).

The orchestrator 116 may include a number of modules directed tomonitoring the execution of the workflows. In this example, theorchestrator 116 includes a system health monitoring module 160 and adependency validation module 162. Additional, fewer, or alternativemonitoring modules may be provided. In some cases, one or more of themodules may be provided as a component of the policy engine 118 (FIG. 1)rather than the orchestrator 116. For example, the policy engine 118 mayinclude the dependency validation module 162. Either way, the policyschema 142 (FIG. 1) may be used to declare dependencies or otherconstraints (e.g., an upgrade order) for the software product.

The monitoring modules may be configured to detect an event, such as afailure, during the execution of a workflow that warrants an alert orother action. The system health monitoring module 160 may be configuredto monitor the health or other state of the computing systemimplementing the orchestrator 116 (or any one or more componentsthereof). The system health monitoring module 160 may thus be configuredto detect improper operating conditions and other conditions that mayadversely impact the execution of the workflow. For example, the systemhealth monitoring module 160 may be relied upon to detect when thecomputing resources (e.g., processor or memory capacity) of thecomputing system are inadequate for the load provided by the workflow.If a system health parameter does not meet a threshold, an alert orother message may then be sent to a user authorized (e.g., via thepolicy schema 142 (FIG. 1)) to respond. In some cases, the system healthmonitoring module 160 may be configured to direct the workflow engine122 to suspend the workflow. The workflow may then resume based on aresponse to the user alert or other user instruction.

Other components or aspects of the release environment may alternativelyor additionally be monitored. The release environment may be anenvironment in which the software product is being used and, thus,subject to an SLA prohibiting or limiting downtime. In this example, thedependency validation module 162 is configured to validate and otherwisemonitor a state of a production environment before releasing a build ofthe software product thereto. The validation may be based on one or morevalidation criteria specified in the policy schema 142 (FIG. 1). Forexample, the validation criteria may involve or specify a number ofdependencies for the portion of the software product to be released. Thedependency validation module 162 may be configured to determine a stateof each dependency (e.g., determine a version of a component) andvalidate the state of the dependency before implementing the release(e.g., confirm that the version is compatible with the release). Suchvalidation may avoid rendering the software product inoperable as aresult of the release. The health of the operating environment governedby the SLA may thus be maintained.

The orchestrator 116 may include additional modules for supporting themanagement of the release workflow. In this embodiment, the orchestrator116 includes an authorization module 164 directed to managing thepermissions of users and/or user roles. The functionality of theauthorization module 164 may alternatively or additionally be providedby one or more components of the front end system 120 (FIG. 1). Theauthorization module 164 may be integrated with such components to anydesired extent. In some embodiments, the role management functionalitydescribed below may thus be provided by a component of the front endsystem 120.

The authorization module 164 may implement a role-based accessmanagement framework for the orchestrator 116 and other components ofthe disclosed systems. Users may be assigned roles to define, limit, orotherwise control the workflow actions, events, or other items withwhich the user may interact or control. For instance, a user assigned toa developer role may be prohibited from approving a release ordeployment to production. The set of permissions may vary considerablywith the nature of the actions involved in a release process. Some rolesmay be capable of initiating a forward integration within a releaseworkflow, but not deployments. Some roles may initiate a build process,but not approve the results of a build.

The policy schema 142 (FIG. 1) may be used to establish rules for theroles. For example, the policy schema 142 may be used to allow onlyusers assigned to a project manager role to approve a release for acertain software product. In this way, other roles may be capable ofapproving a release for other software products. Alternatively oradditionally, the authorization module 164 and/or the authorizationmodule 138 (FIG. 1) of the front end system 120 (FIG. 1) may be used toestablish permissions for the roles. In some cases, the permissions maybe global (e.g., across all software products, environments, etc.) ordefault values that may be customized or overridden by permissionsspecified via the policy schema 142.

A variety of different roles and permissions for such roles may beestablished via the authorization module 164. An administrator role maybe defined to provide override and other control capabilities,including, for instance, those referenced above. Some roles may classifya user in accordance with a team involved in the software releaseprocess, such as an operations team or a testing team.

The authorization module 164 may include role manager functionality. Forexample, the authorization module 164 may be configured to map users toroles and/or permissions, and/or to map roles to software products. Therole manager functionality may allow the authorization module 164 toapply permissions on a product-by-product basis. Users may thus beassociated with one or more specific products and/or one or morespecific services.

In some embodiments, the role access framework may include a datastructure for classifying role membership, role access or permissions,and scope definition. The role membership data may specify which usersbelong to which role(s). Roles need not correspond with a corporatestructure (e.g., project manager, etc.), but rather may be specific tothe release process (e.g., approvers, initiators, etc.). Alternativelyor additionally, the role membership data may specify the products orservices with which the user is associated. The role membership data mayalso specify the scope of such associations, such as the components ofsuch products or services with which the user is associated. A user maythus be associated with a team building a portal for the softwareproduct, but not a team building a software development kit for the sameproduct. The role access data may specify the permissions for each role.

The front end system 120 (FIG. 1) may be used to establish the roleaccess framework. For example, an administrator user may enter the rolemembership data, the role access data, and/or the scope definition datavia the authorization module 138. Alternatively or additionally, suchauthorization data may be specified and/or managed via an externalservice (e.g., a directory service) or system, such as a cloud-basedsystem or a corporate system.

FIG. 3 depicts an exemplary method for managing a software release. Themethod is computer-implemented. For example, one or more servercomputers of the release management system 102 shown in FIG. 1 may beconfigured to implement one or more of the acts of the method. Theimplementation of each act may be directed by respectivecomputer-readable instructions executed by a processor of the releasemanagement system 102 and/or another processor or processing system.

In the embodiment of FIG. 3, the method begins with an act 200 in whicha user is authenticated. The user may be authenticated in connectionwith an attempt to access the release management system 102 (FIG. 1) viathe front end system 120 (FIG. 1). The user may be accessing the releasemanagement system 102 for various reasons. Given the appropriatepermissions, the user may access the release management system 102, forinstance, to initiate, suspend, or cancel a release, to monitor anongoing release, to configure or manage a release workflow, and/or toconfigure the release management system 102 (e.g., modify a templateworkflow). The authentication may be managed by the authenticationmodule 136 (FIG. 1) of the front end system 136 and/or one or moreexternal authentication systems (e.g., a federated database system). Forexample, the authentication process may include accessing a privatenetwork user directory in an act 202.

In some cases, an administrator user may access the release managementsystem 102 to define the permissions of various user roles in an act203. Data indicative of the permissions may be stored in, for example,the workflow data store 124 (FIG. 1) or other data store for subsequentaccess by the authorization module 138 (FIG. 1) and/or the authorizationmodule 164 (FIG. 2). Additional or alternative authorization data may bestored. Data indicative of the permissions may be stored at anothertime, such as during an initial configuration session.

In act 204, a request is received or otherwise obtained for a release.The request specifies or includes workflow action parameter data todefine a release pipeline involving a combination of softwareengineering systems. For example, a user may specify a software productto be released (including, e.g., a source code location), a targetenvironment to which the software is to be released, an order of thesoftware engineering systems in the pipeline, and/or a selection of asubset of such systems. Additional, fewer, or alternative workflowparameters may be specified in connection with the release request. Eachsoftware engineering system may be configured to process data indicativeof the software product to be released, as described above.

The front end system 120 (FIG. 1) may facilitate the specification ofthe workflow action parameter data by generating the user interface 126(FIG. 1) or other request specification user interface in an act 206.The layout and other characteristics of the user interface may vary. Insome cases, the user interface may allow the user to create, modify, orotherwise configure a workflow for execution. The configuration mayinclude entering workflow code to customize a template workflow tocreate a new workflow.

Once the workflow request and/or the workflow parameter action data isspecified, the method may then include confirming that the user isauthorized to initiate the workflow in an act 208. The authorizationprocess may include determining a user role of the user and determiningthe permissions of the user role for a given software product. Thepermissions may be configured to authorize the user to initiate certaintypes of releases or workflow actions, but not others. The authorizationprocess may be implemented by the authorization module 138 (FIG. 1)and/or the authorization module 164 (FIG. 2).

Code and/or data indicative of the workflow may be processed in an act210. In some embodiments, the workflow may be based on a templateworkflow modified in accordance with the workflow parameter action data.The workflow template may be processed in preparation for execution oncemodified in accordance with the workflow parameter action data. Theprocessing may include code interpretation, workflow validation,compilation, linking, and other code processing.

In some embodiments, an act 212 is implemented to obtain an approval orsign-off of the initiation of a release workflow before the execution ofthe workflow begins. For example, a notification may be sent to a userauthorized to approve the release. The notification may include anemail, a text message, or any other transmission. The notification mayspecify data indicative of the release workflow, including, forinstance, one or more parameters specified via the workflow actionparameter data, such as the release pipeline. A decision block 214determines whether the release is approved. If yes, then control passesto a set of blocks associated with execution of the workflow. If therelease is not approved, then the method ends and the release process isdiscontinued. Alternatively, control may pass to a state in which a useris given an opportunity to take a corrective action (e.g., an update ormodification to address a comment from an approver).

The workflow is executed in an act 216 in which a series of instructionsare sent to the software engineering systems in the release pipeline.The release pipeline is implemented in accordance with the workflowaction parameter data. The execution of the workflow may include orinvolve data generation for monitoring, compliance, or other purposes.At various points in the workflow, further execution of the workflow(e.g., a next step in the pipeline) may involve obtaining an approvalfrom an authorized user. In the embodiment of FIG. 3, a callback 217 tothe act 212 may be implemented to send another notification to anapprover. Further execution of the workflow may then continue if thedecision block 214 determines that the approval is received.

In this example, data indicative of such approvals, workflow metrics,and/or other data indicative of actions implemented during workflowexecution are recorded in an act 218. For example, such data may berecorded in one or more log files, which may be stored in one of theabove-referenced data stores and/or another data store. Such data mayspecify a user who approved a specific action (e.g., the initiation ofthe workflow), as described herein. The act 218 may also include thepresentation of data indicative of the workflow execution via adashboard generated by the front end system 120 (FIG. 1). The dashboardmay display workflow metric data as described above. One or more metricsto be displayed via the dashboard during execution of the workflow maybe specified via the workflow action parameter data provided inconnection with the release request.

A policy schema may be accessed in an act 220 to obtain any gating orother rules for the workflow. The policy schema may include aconfiguration file, such as an XML file, as described above.Alternatively or additionally, data indicative of some or all of thepolicy schema (and/or gating rules) may be accessed via anothermechanism, such as via a user interface generated by the releasemanagement system 102 (FIG. 1). For example, a gating rule may beprovided via a user interface during the execution of the workflow. Insome embodiments, the policy schema may be accessed to configure aninstruction in the series of instructions provided to the softwareengineering systems, which may, for example, involve application of oneor more gating rules.

During execution of the workflow, a successive instruction in the seriesof instructions is sent based on whether a transition criterion or othergating rule of the configuration file or other specification of thepolicy schema for the release is met. In this embodiment, an entrycriterion or an exit criterion is applied in an act 222. Such transitioncriteria may specify, for example, quality assurance rules for enteringor exiting a step in the workflow, as described above. Alternatively,one of the transition criteria may specify a production environmentcompliance rule for entering or exiting a step in the workflow, as alsodescribed above. In yet another example, one of the transition criteriamay specify a user role to approve implementation of a successiveinstruction in the series of instructions, including, for instance,initiation of the workflow. The transition criteria may be applied via apolicy engine. The policy engine may configure an instruction in theseries of instructions based on the gating rule(s) of the policy schema.

The embodiment of FIG. 3 includes a number of acts that may beimplemented during execution of the workflow. In some cases, theworkflow action parameter data specifies that such acts be implemented.A system health parameter of a computer (e.g., a server computer) orcomputing system executing the workflow may be monitored in an act 224.A state of the production environment may be monitored or validated inan act 226 to ensure that a validation criterion (relating to, e.g., adependency of the software product) is met before, for instance, a buildis released to the production environment. In dependency validationexamples, validating the state of the production environment may thusinclude determining a state of the dependency, and validating the stateof the dependency before implementing the release. A release action orother event (e.g., a release to the production environment) may bescheduled in an act 228 for a later time based on the state of theproduction environment (or other state monitored during workflowexecution). The scheduling may include specifying a constraint orcondition to be met (relating to, e.g., a state of the dependency)before allowing the release or workflow action to be implemented.

A decision block 230 may determine whether an incident has occurredduring workflow execution. A workflow incident may occur due to afailure to meet a transition criterion or other gating rule. Forexample, the decision block 230 may determine whether a system healthparameter does not meet a threshold during the monitoring of the act224, or whether a dependency of the software product does not meet avalidation criterion during the validation of the act 226. Additional,fewer, or alternative types of incidents may be monitored. If anincident occurs, an alert is sent in an act 232 to a user authorized torespond. The authorization of the user to respond to the incident may beestablished or specified via the policy schema as described above (e.g.,via a user role assignment). Another decision block 234 determineswhether the workflow may be restarted, resumed (e.g., a workflow actionmay be retried), or skipped based on a response to the alert (e.g., froman authorized user). If a suitable response is received, control mayreturn to the act 216 for further workflow execution. If not, then theexecution of the release workflow may terminate. In some embodiments,the response to the alert may involve or include a gating rule change(e.g., within the above-referenced decision engine) or other change thatrenders the original criterion no longer applicable. In such cases, theworkflow may resume automatically.

The release workflow may also be terminated via an override or othercontrol provided by an administrator or other authorized user. Forexample, the decision block 230 may be configured to suspend theexecution of the workflow as shown in FIG. 3.

If the decision block 230 is reached after successful implementation ofthe series of instructions in the workflow (e.g., without any incidentsor any unaddressed incidents), then control may pass to an act 236 inwhich an alert or other message is sent indicating the successfulcompletion of the release.

The order of the acts of the method may vary in addition to thosevariations identified above. For example, the policy schema may beaccessed before the execution of the workflow and/or the processing ofthe workflow code. The workflow may thus be configured in accordancewith the policy schema and the workflow action parameter data beforeexecution. In such cases, one or more gating rules of the policy schemamay alternatively or additionally be specified during execution, asdescribed above.

With reference to FIG. 4, an exemplary computing environment 300 may beused to implement one or more aspects or elements of the above-describedmethods and/or systems. The computing environment 300 may be used by, orincorporated into, one or more elements of the release management system102 (FIG. 1). For example, the computing environment 300 may be used toimplement the orchestrator 116, the workflow engine 122, the policyengine 118, and/or the front end system 120. The computing environment300 may be used or included as a client, network server, applicationserver, or database management system or other data store manager, ofany of the aforementioned elements or system components. The computingenvironment 300 may be used to implement one or more of the actsdescribed in connection with FIG. 3.

The computing environment 300 includes a general-purpose computingdevice in the form of a computer 310. Components of computer 310 mayinclude, but are not limited to, a processing unit 320, a system memory330, and a system bus 321 that couples various system componentsincluding the system memory to the processing unit 320. The system bus321 may be any of several types of bus structures including a memory busor memory controller, a peripheral bus, and a local bus using any of avariety of bus architectures. By way of example, and not limitation,such architectures include Industry Standard Architecture (ISA) bus,Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, VideoElectronics Standards Association (VESA) local bus, and PeripheralComponent Interconnect (PCI) bus also known as Mezzanine bus. The units,components, and other hardware of computer 310 may vary from the exampleshown.

Computer 310 typically includes a variety of computer readable storagemedia configured to store instructions and other data. Such computerreadable storage media may be any available media that may be accessedby computer 310 and includes both volatile and nonvolatile media,removable and non-removable media. Such computer readable storage mediamay include computer storage media as distinguished from communicationmedia. Computer storage media includes both volatile and nonvolatile,removable and non-removable media implemented in any method ortechnology for storage of information such as computer readableinstructions, data structures, program modules or other data. Computerstorage media includes, but is not limited to, RAM, ROM, EEPROM, flashmemory or other memory technology, CD-ROM, digital versatile disks (DVD)or other optical disk storage, magnetic cassettes, magnetic tape,magnetic disk storage or other magnetic storage devices, or any othermedium which may be used to store the desired information and which mayaccessed by computer 310.

The system memory 330 includes computer storage media in the form ofvolatile and/or nonvolatile memory such as read only memory (ROM) 331and random access memory (RAM) 332. A basic input/output system 333(BIOS), containing the basic routines that help to transfer informationbetween elements within computer 310, such as during start-up, istypically stored in ROM 331. RAM 332 typically contains data and/orprogram modules that are immediately accessible to and/or presentlybeing operated on by processing unit 320. By way of example, and notlimitation, FIG. 4 illustrates operating system 334, applicationprograms 335, other program modules 336, and program data 337. Forexample, one or more of the application programs 335 may be directed toimplementing one or more components of the orchestrator 116, theworkflow engine 122, the policy engine 118, the front end system 120,and/or any instruction sets of the systems and methods described above.In this or another example, any one or more the instruction sets in theabove-described memories or data storage devices may be stored asprogram data 337.

Any one or more of the operating system 334, the application programs335, the other program modules 336, and the program data 337 may bestored on, and implemented via, a system on a chip (SOC). Any of theabove-described modules may be implemented via one or more SOC devices.The extent to which the above-described modules are integrated in a SOCor other device may vary.

The computer 310 may also include other removable/non-removable,volatile/nonvolatile computer storage media. By way of example only,FIG. 4 illustrates a hard disk drive 341 that reads from or writes tonon-removable, nonvolatile magnetic media, a magnetic disk drive 351that reads from or writes to a removable, nonvolatile magnetic disk 352,and an optical disk drive 355 that reads from or writes to a removable,nonvolatile optical disk 356 such as a CD ROM or other optical media.Other removable/non-removable, volatile/nonvolatile computer storagemedia that may be used in the exemplary operating environment include,but are not limited to, magnetic tape cassettes, flash memory cards,digital versatile disks, digital video tape, solid state RAM, solidstate ROM, and the like. The hard disk drive 341 is typically connectedto the system bus 321 through a non-removable memory interface such asinterface 340, and magnetic disk drive 351 and optical disk drive 355are typically connected to the system bus 321 by a removable memoryinterface, such as interface 350.

The drives and their associated computer storage media discussed aboveand illustrated in FIG. 4, provide storage of computer readableinstructions, data structures, program modules and other data for thecomputer 310. For example, hard disk drive 341 is illustrated as storingoperating system 344, application programs 345, other program modules346, and program data 347. These components may either be the same as ordifferent from operating system 334, application programs 335, otherprogram modules 336, and program data 337. Operating system 344,application programs 345, other program modules 346, and program data347 are given different numbers here to illustrate that, at a minimum,they are different copies. A user may enter commands and informationinto the computer 310 through input devices such as a keyboard 362 andpointing device 361, commonly referred to as a mouse, trackball or touchpad. Other input devices (not shown) may include a microphone (e.g., forvoice control), touchscreen (e.g., for touch-based gestures and othermovements), ranger sensor or other camera (e.g., for gestures and othermovements), joystick, game pad, satellite dish, and scanner. These andother input devices are often connected to the processing unit 320through a user input interface 360 that is coupled to the system bus,but may be connected by other interface and bus structures, such as aparallel port, game port or a universal serial bus (USB). In someimplementations of the computer 310, a monitor 391 or other type ofdisplay device is also connected to the system bus 321 via an interface,such as a video interface 390. In addition to the monitor, computers mayalso include other peripheral output devices such as printer 396 andspeakers 397, which may be connected through an output peripheralinterface 395.

The computer 310 may operate in a networked environment using logicalconnections to one or more remote computers, such as a remote computer380. The remote computer 380 may be a personal computer, a server, arouter, a network PC, a peer device or other common network node, andtypically includes many or all of the elements described above relativeto the computer 310, although only a memory storage device 381 has beenillustrated in FIG. 4. The logical connections include a local areanetwork (LAN) 371 and a wide area network (WAN) 373, but may alsoinclude other networks. Such networking environments are commonplace inoffices, enterprise-wide computer networks, intranets and the Internet.

When used in a LAN networking environment, the computer 310 is connectedto the LAN 371 through a network interface or adapter 370. When used ina WAN networking environment, the computer 310 typically includes amodem 372 or other means for establishing communications over the WAN373, such as the Internet. The modem 372, which may be internal orexternal, may be connected to the system bus 321 via the user inputinterface 360, or other appropriate mechanism. In a networkedenvironment, program modules depicted relative to the computer 310, orportions thereof, may be stored in the remote memory storage device.FIG. 4 illustrates remote application programs 385 as residing on memorydevice 381. The network connections shown are exemplary and other meansof establishing a communications link between the computers may be used.

The computing environment 300 of FIG. 4 is only one example of asuitable computing environment and is not intended to suggest anylimitation as to the scope of use or functionality of the technologyherein. Neither should the computing environment 300 be interpreted ashaving any dependency or requirement relating to any one or combinationof components illustrated in the exemplary operating environment 300.

The technology described herein is operational with numerous othergeneral purpose or special purpose computing system environments orconfigurations. Examples of well-known computing systems, environments,and/or configurations that may be suitable for use with the technologyherein include, but are not limited to, personal computers, servercomputers (including server-client architectures), hand-held or laptopdevices, mobile phones or devices, multiprocessor systems,microprocessor-based systems, set top boxes, programmable consumerelectronics, network PCs, minicomputers, mainframe computers,distributed computing environments that include any of the above systemsor devices, and the like.

The technology herein may be described in the general context ofcomputer-executable instructions, such as program modules, beingexecuted by a computer. Generally, program modules include routines,programs, objects, components, data structures, and so forth thatperform particular tasks or implement particular abstract data types.The technology herein may also be practiced in distributed computingenvironments where tasks are performed by remote processing devices thatare linked through a communications network. In a distributed computingenvironment, program modules may be located in both local and remotecomputer storage media including memory storage devices.

While the present invention has been described with reference tospecific examples, which are intended to be illustrative only and not tobe limiting of the invention, it will be apparent to those of ordinaryskill in the art that changes, additions and/or deletions may be made tothe disclosed embodiments without departing from the spirit and scope ofthe invention.

The foregoing description is given for clearness of understanding only,and no unnecessary limitations should be understood therefrom, asmodifications within the scope of the invention may be apparent to thosehaving ordinary skill in the art.

What is claimed is:
 1. A computer-implemented method for managing arelease of a software product, the method comprising: obtaining arequest for the release, the request comprising workflow actionparameter data that defines a release pipeline involving a plurality ofsoftware engineering systems, each software engineering system of theplurality of software engineering systems being configured to provide arespective software release service that processes data indicative ofthe software product, the workflow action parameter data specifying thatthe release pipeline includes at least a build step; providing afront-end user interface that enables creation of the workflow actionparameter data including creation of the build step via the front-enduser interface, modification of the workflow action parameter dataincluding modification of the build step via the front-end userinterface, and specification of options associated with display ofmetric data via a dashboard including specification of optionsassociated with the build step via the front-end user interface, whereinthe metric data is associated with the release pipeline; and executing,with one or more processors, a workflow to implement the releasepipeline in accordance with the workflow action parameter data; whereinexecuting the workflow comprises providing release management servicesvia a scalable plurality of instances of an orchestrator and schedulingan event for a time based on a state of the release monitored duringworkflow execution; wherein providing the release management servicescomprises sending, by one or more of the instances of the orchestrator,a series of instructions to the plurality of software engineeringsystems, each instruction directing respective one of the plurality ofsoftware engineering systems to implement the respective softwarerelease service; and wherein a successive instruction in the series ofinstructions is sent based on whether a gating rule for the release ismet.
 2. The computer-implemented method of claim 1, further comprisingaccessing a configuration file that comprises data indicative of thegating rule, the configuration file being discrete from a data packagein which the workflow action parameter data is stored, wherein thegating rule is applied in an automated manner.
 3. Thecomputer-implemented method of claim 1, further comprising receiving thegating rule via a user interface during execution of the workflow. 4.The computer-implemented method of claim 1, wherein the gating rulespecifies a compliance parameter for approval of a respective step ofthe workflow.
 5. The computer-implemented method of claim 1, wherein thegating rule specifies a quality assurance policy.
 6. Thecomputer-implemented method of claim 1, wherein the plurality ofsoftware engineering systems comprises a source control systemconfigured to provide version control, a build system configured tocompile source code data into binary code, and a validation systemconfigured to validate operability of the binary code.
 7. Thecomputer-implemented method of claim 1, wherein each softwareengineering system of the plurality of software engineering systemscomprises an interface configured to support data exchanges with one ormore instances of the plurality of scalable instances of theorchestrator.
 8. The computer-implemented method of claim 7, wherein theinterface comprises an application programming interface (API).
 9. Thecomputer-implemented method of claim 1, wherein the workflow actionparameter data specifies that the release pipeline includes a build stepand a deployment step.
 10. The computer-implemented method of claim 1,wherein obtaining the request comprises receiving the workflow actionparameter data via an application programming interface (API) of arespective instance of the orchestrator.
 11. The computer-implementedmethod of claim 1, wherein the gating rule specifies a validationcriterion for validation of the software product before releasing abuild of the software product to a production environment.
 12. Thecomputer-implemented method of claim 1, wherein the gating rulespecifies a code coverage threshold.
 13. The computer-implemented methodof claim 1, wherein executing the workflow comprises interpretingworkflow code by a workflow interpreter of a respective instance of theorchestrator.
 14. Computer storage media for implementing a method ofmanaging a release of a software product, the computer storage mediahaving stored thereon computer-executable instructions that, whenexecuted by one or more processors of a computing system, cause thecomputing system to perform the method, the method comprising: receivinga request for the release, the request comprising workflow actionparameter data that defines a release pipeline involving a plurality ofsoftware engineering systems, each software engineering system of theplurality of software engineering systems being configured to provide arespective software release service that processes data indicative ofthe software product, the workflow action parameter data specifying thatthe release pipeline includes at least a build step; providing afront-end user interface that enables creation of the workflow actionparameter data including creation of the build step via the front-enduser interface, modification of the workflow action parameter data, andspecification of options associated with display of metric data via adashboard, wherein the metric data is associated with the releasepipeline; executing a workflow to implement the release pipeline inaccordance with the workflow action parameter data and a policy schema;wherein executing the workflow comprises providing release managementservices via a scalable plurality of instances of an orchestrator andscheduling an event for a time based on a state of the release monitoredduring workflow execution; and wherein providing the release managementservices comprises: sending, by one or more of the instances of theorchestrator, a series of instructions to the plurality of softwareengineering systems, each instruction directing a respective one of theplurality of software engineering systems to implement the respectivesoftware release service; accessing a configuration file that comprisesdata indicative of the policy schema; and applying a gating rule of thepolicy schema to determine whether a successive instruction in theseries of instructions is sent.
 15. The articic of manufacturc computerstorage media of claim 14, wherein the gating rule specifies avalidation criterion for validation of the software product.
 16. Adevice for managing a release of a software product, the devicecomprising: at least one memory and at least one processor, wherein theat least one memory and the at least one processor are respectivelyconfigured to store and execute instructions for causing the device toperform operations, the operations comprising: obtaining a request forthe release, the request comprising workflow action parameter data thatdefines a release pipeline involving a plurality of software engineeringsystems, each software engineering system of the plurality of softwareengineering systems being configured to provide a respective softwarerelease service that processes data indicative of the software product,the workflow action parameter data specifying that the release pipelineincludes at least a build step; providing a front-end user interfacethat enables creation of the workflow action parameter data includingcreation of the build step via the front-end user interface,modification of the workflow action parameter data, and specification ofoptions associated with display of metric data via a dashboard, whereinthe metric data is associated with the release pipeline; and executing aworkflow that implements the release pipeline in accordance with theworkflow action parameter data, including: providing release managementservices via a scalable plurality of instances of an orchestrator,including: sending a series of instructions to the plurality of softwareengineering systems, each instruction directing a respective one of theplurality of software engineering systems to implement the respectivesoftware release service, wherein a successive instruction in the seriesof instructions is sent based on whether a gating rule for the releaseis met.
 17. The device of claim 16, wherein the operations furthercomprise accessing a configuration file that comprises data indicativeof the gating rule, the configuration file being discrete from a datapackage in which the workflow action parameter data is stored.
 18. Thedevice of claim 16, wherein the gating rule is received via a userinterface during execution of the workflow.
 19. The device of claim 16,wherein the workflow action parameter data is received via a userinterface during execution of the workflow.